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(54) Title: TELEVISION PROGRAM RECOMMENDER WITH AUTOMATIC IDENTIFICATION OF CHANGING VIEWER 
PREFERENCES 

(57) Abstract: A television program recommender is disclosed that automatically identifies changes in viewing preferences. Once 
changing viewing preferences are identified, the disclosed television programming recommender can (i) adapt the generated televi- 
sion program recommendations to such changes in viewing preferences, or (ii) more efficiently manage the storage of the viewing 
history. For cyclical or periodic changes in viewing preferences, the television programming recommender generates television 
program recommendations using a sub-set of the viewing history from a corresponding earlier time period. Likewise, for true or 
permanent changes in viewing preferences, the television programming recommender optionally generates television program rec- 
ommendations using the most recent sub-set of the viewing history, which most likely reflects the current viewing preferences. In a 
further variation, program recommendations can be generated using a combination, such as the union or intersection, of recommen- 
dations based on viewing histories from two different periods of time. The television programming recommender can confirm that 
viewing preferences have not changed significantly over time, and thereafter delete portions of the viewing history without loss of 
any performance in the generated recommendations. 
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Television program recommender with automatic identification of changing viewer 
preferences 



Field of the Invention 

The present invention relates to television program recommenders, and more 
particularly, to a method and apparatus for generating television program recommendations. 

5 Background of the Invention 

As the number of channels available to television viewers has increased, along 
with the diversity of the prograrnming content available on such channels, it has become 
increasingly challenging for television viewers to identify television programs of interest. 
Historically, television viewers identified television programs of interest by analyzing printed 

10 television program guides. Typically, such printed television program guides contained grids 
listing the available television programs by time and date, channel and title. As the number 
of television programs has increased, it has become increasingly difficult to effectively 
identify desirable television programs using such printed guides. 

More recently, television program guides have become available in an 

1 5 electronic format, often referred to as electronic program guides (EPGs). Like printed 

television program guides, EPGs contain grids listing the available television programs by 
time and date, channel and title. Some EPGs, however, allow television viewers to sort or 
search the available television programs in accordance with personalized preferences. In 
addition, EPGs allow for on-screen presentation of the available television programs. 

20 While EPGs allow viewers to identify desirable programs more efficiently 

than conventional printed guides, they suffer from a number of limitations, which if 
overcome, could further enhance the ability of viewers to identify desirable programs. For 
example, many viewers have a particular preference towards, or bias against, certain 
categories of programming, such as action-based programs or sports programming. Thus, the 

25 viewer preferences can be applied to the EPG to obtain a set of recommended programs that 
may be of interest to a particular viewer. 

Thus, a number of tools have been proposed or suggested for recommending 
television programming. The Tivo™ system, for example, commercially available from Tivo, 
Inc., of Sunnyvale, California, allows viewers to rate shows using a "Thumbs Up and 
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Thumbs Down" feature and thereby indicate programs that the viewer likes and dislikes, 
respectively. Thereafter, the TiVo receiver matches the recorded viewer preferences with 
received program data, such as an EPG, to make recommendations tailored to each viewer. 

Such tools for generating television program recommendations provide 
5 selections of programs that a viewer might like, based on their prior viewing history. While 
such television program recommenders help a user to identify television programs of interest, 
they suffer from a number of limitations, which if overcome, could greatly improve the 
performance in the generated recommendations. For example, with such conventional tools 
for generating television program recommendations, changes in the television viewing habits 

10 of a viewer, often referred to as "non-stationary viewing preferences," are not easily 
identified. Furthermore, conventional tools for generating television program 
recommendations consider a person's viewing history as a whole when generating a viewer 
profile and television program recommendation scores. 

In addition, with such conventional tools for generating television program 

15 recommendations, it is hard to identify portions of a user's viewing history that can be 

deleted. Thus, unnecessary portions of the user's viewing history are often maintained longer 
than necessary and some desired portions could be prematurely deleted. Generally, if 
viewing preferences do not change much over time, older viewing histories can be deleted 
without loss of any performance in the generated recommendations. There is currently no 

20 way, however, to determine if the viewer's preferences have changed. 

A need therefore exists for methods and apparatus for generating television 
program recommendations that identify changing viewer preferences. A further need 
therefore exists for methods and apparatus for generating television program 
recommendations that adapt television program recommendations to changing viewer 

25 preferences. 

Summary of the Invention 

Generally, a method and apparatus are disclosed for generating television 
program recommendations based on the prior viewing history of a viewer. According to one 

30 aspect of the invention, changes in the viewing preferences are automatically identified. 

Furthermore, once changing viewing preferences are identified, the disclosed television 
programming recommender (i) adapts the generated television program recommendations to 
such changes in viewing preferences, or (ii) more efficiently manages the storage of the 
viewing history. 
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For cyclical or periodic changes in viewing preferences, such as repetitive 
changes corresponding to the time of day or time of year, the television programming 
recommender generates television program recommendations using a sub-set of the viewing 
history from a corresponding earlier time period. Likewise, for true or permanent changes in 
viewing preferences, the television programming recommender optionally generates 
television program recommendations using the most recent sub-set of the viewing history, 
which most likely reflects the current viewing preferences. In another variation, program 
recommendations can be generated using a combination, such as the union or intersection, of 
recommendations based on two different periods of time. 

According to another aspect of the invention, the disclosed television 
programming recommender identifies portions of a user's viewing history that can be deleted 
without loss of information. The television programming recommender confirms that 
viewing preferences have not changed significantly over time, and thereafter deletes older 
portions of the viewing history without loss of any performance in the generated 
recommendations. 

Generally, the present invention establishes at least two sub-sets, VHi arid 
VHk, from the available viewing history of a user. The disclosed television programming 
recommender generates viewer profiles, Pi and P K , corresponding to each viewing history 
sub-set, respectively. Thereafter, the television programming recommender utilizes the 
viewer profiles, Pi and Pig to generate a corresponding set of program recommendation 
scores for the programs in a given time interval. 

The top-N (where N is a positive integer) recommended television programs, 
Si and Sk, are evaluated. If the two sets of programs, Si and Sk, are identical, then the 
viewer's preferences have not changed significantly. Thus, the oldest portions of the viewing 
history can be discarded without loss of information. If, however, the two sets of top-N 
programs, Si and Sk, are different, then the television programming recommender has 
identified a non-stationary viewer preference. In the event that a change in viewing 
preferences is detected, the television programming recommender can present the user with 
one or both sets of programs. Si and Sk» or a combination of the two sets, such as a union or 
intersecting set. 

A more complete understanding of the present invention, as well as further 
features and advantages of the present invention, will be obtained by reference to the 
following detailed description and drawings. 
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4 ' 
Brief Description of the Drawings i 

FIG. 1 illustrates a television programming recommender in accordance with $ 
the present invention; 

FIG. 2 illustrates the processing of a viewing history in accordance with the 
present invention; 

FIG. 3 is a sample table from the program database of FIG. 1 ; and 1 
FIG. 4 is a flow chart describing an exemplary viewer preference evaluation \ 
process embodying principles of the present invention. 



10 Detailed Description 

FIG. 1 illustrates a television programming recommender 100 in accordance 
with the present invention. As shown in FIG. 1 , the television programming recommender 
100 evaluates each of the programs in an electronic programming guide (EPG) 1 10 to 
identify programs of interest to a particular user. The set of recommended programs can be 

1 5 presented to the user using a set-top terminal/television 1 50, for example, using well known 
on-screen presentation techniques. The television programming recommender 1 00 identifies 
programs that a viewer might like, based on their prior viewing history 200, discussed ftirther 
below in conjunction with FIG. 2; 

According to one feature of the present invention, discussed further below in 

20 conjunction with FIG. 2, the television programming recommender 100 considers sub-sets of 
the entire viewing history 200 when generating television program recommendations. Thus, 
the entire viewing history 200 is analyzed in parts and multiple viewing profiles are 
generated for a single person. For each sub-set of the viewing history 200, the television 
programming recommender 100 generates a corresponding user profile that can be utilized to 

25 generate television program recommendation scores. In one embodiment, each sub-set of the 
viewing history 200 is selected by either (i) uniformly randomly sampling sub-sets of 
television programs from the entire viewing history 200, or (ii) selecting a time span that is 
less than the entire time period covered by the viewing history 200. 

In this manner, the television programming recommender 100 can identify 

30 non-stationary viewer preferences. Furthermore, once changing viewing preferences are 
identified, the television programming recommender 100 can (i) adapt the generated 
television program recommendations to such changes in viewing preferences, and (ii) more 
efficiently manage the storage of the viewing history 200. For cyclical or periodic changes in 
viewing preferences, such as repetitive changes corresponding to the time of day or time of 
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year, the television programming recommender 100 generates television program 
recommendations using a sub-set of the viewing history 200 from a corresponding earlier 
time period. Likewise, for true or permanent changes in viewing preferences, the television 
programming recommender 100 generates television program recommendations using the 
5 most recent sub-set of the viewing history 200, which most likely reflects the current viewing 
preferences. 

For example, the viewing habits of many viewers may change temporarily 
during the fall season with the start of a new television season, or during the playoffs of a 
given sport. Likewise, the viewing habits of a given viewer may be different in the morning 

10 hours as compared to the evening hours. Thus, the performance of the television 

programming recommender 100 can improve if the portion of the viewing history 200 that is 
used to generate the program recommendations more closely resembles the time period of 
interest In other words, if a viewer changed his or her viewing preferences, the programs 
corresponding to the new preferences would appear in the most recent viewing history. 

15 According to another feature of the present invention, the television 

programming recommender 100 identifies portions of a user's viewing history that can be 
deleted. The television programming recommender 100 of the present invention can confirm 
that viewing preferences have not changed significantly over time, and thereby delete older 
portions of the viewing history without loss of any performance in the generated 

20 recommendations. 

As shown in FIG. 1, the television programming recommender 100 contains a 
viewing history 200, discussed further below in conjunction with FIG. 2, a program database 
300, discussed further below in conjunction with FIG. 3, and a viewer preference evaluation 
process 400, discussed further below in conjunction with FIG. 4. Generally, the viewing 

25 history 200 contains the set of shows that was watched (and/or not watched) by the viewer 
over a period of time. The program database 300 records information for each program that 
is available in a given time interval. The viewer preference evaluation process 400 generates 
recommendation scores for each program in a particular time interval, taking into account 
non-stationary viewing preferences in accordance with the present invention, and displays the 

30 programs together with an indication of the recommendation score assigned to each program 
by the television programming recommender 100. 

The television program recommender 100 may be embodied as any computing 
device, such as a personal computer or workstation. In addition, the television programming 
recommender 100 may be embodied as any available television program recommender, such 
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as the Tivo™ system, commercially available from Tivo, Inc., of Sunnyvale, California, or 
the television program recommenders described in United States Patent Application Serial 
No. 09/466,406, filed December 17, 1999, entitled "Method and Apparatus for 
Recommending Television Programming Using Decision Trees," (Attorney Docket No. 
5 700772) and United States Patent Application Serial No. 09/498,271, filed Feb. 4, 2000, 
entitled "Bayesian TV Show Recommender," (Attorney Docket No. 700690), or any 
combination thereof, as modified herein to carry out the features and functions of the present 
invention. 

FIG. 2 illustrates the processing of the viewing history 200 in accordance with 
10 the present invention. As shown in FIG. 2, at least two sub-sets, VHi and VHk, are 

established from the viewing history 200. The viewing history sub-sets, VHi and VHk, 
correspond to the sets of shows watched by the viewer during time spans Ti and T2, 
respectively. In the example shown in FIG. 2, time spans Ti and T 2 are non-overlapping. 
The time spans Ti and T2 could easily be overlapping, however, as would be apparent to a 
15 person of ordinary skill in the art. Furthermore, one or both time spans Ti and T2 can be 
discontinuous, and need not be of equal duration. The illustrative viewing history sub-sets, 
VHi and VHk, correspond to time spans that are less than the entire time period covered by 
the viewing history 200. If a viewer changed his or her viewing preferences from time span 
Ti to time span T2, the programs corresponding to the new preferences would appear in time 
20 spanT 2 . 

As shown in FIG. 2, and discussed further below in conjunction with FIG. 4, 
the television programming recommender 100 in accordance with the present invention 
generates a viewer profile, Pi and Pk, corresponding to each time span, respectively. 
Thereafter, the television programming recommender 100 utilizes the viewer profiles, Pi and 
25 Pk* to generate a corresponding set of program recommendation scores for the programs in a 
given time interval. 

The television programming recommender 100 then processes the 
corresponding top-N (where N is a positive integer) sets of recommended programs, Si and 
Sr. If the two sets of programs, Si and Sr, are identical, then the viewer's preferences have 
30 not changed, or at least have not changed enough so that the television programming 
recommender 100 can perceive the difference. Thus, the oldest portions of the viewing 
history 200 (VHi in the present example) can be discarded. 

If, however, the two sets of programs, Si and Sk, are different, with some 
number of programs in common, then the television programming recommender 100 has 
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identified the common thread Finally, if the two sets of programs, Si and Sk, are different, 
with no programs in common, then the viewer's preferences have changed completely 
between the two selected time periods. In the event that a change in viewing preferences is 
detected, the television programming recommender 100 can present one or both sets of 
5 programs, Si and Sr, or a combination of the two sets, such as a union or intersecting set 

FIG. 3 is a sample table from the program database 300 of FIG. 1 that records 
information for each program that is available in a given time interval. As shown in FIG. 3, 
the program database 300 contains a plurality of records, such as records 305 through 320, 
each associated with a given program. For each program, the program database 300 indicates 

10 the date/time and channel associated with the program in fields 340 and 345, respectively. In 
addition, the title and genre for each program are identified in fields 350 and 355. Additional 
well-kno wn attributes (not shown), such as actors, duration, and description of the program, 
can also be included in the program database 300. 

In accordance with one feature of the present invention, the program database 

1 5 300 also records an indication of the recommendation score assigned to each program by the 
television programming recommender 100 in field 370. In this manner, the numerical scores 
can be displayed to the user in the electronic program guide with each program directly or 
mapped onto a color spectrum or another visual cue that permits the user to quickly locate 
programs of interest 

20 FIG. 4 is a flow chart describing an exemplary viewer preference evaluation 

process 400 embodying principles of the present invention. As shown in FIG. 4, the viewer 
preference evaluation process 400 initially obtains the electronic program guide (EPG) 1 10 
during step 410 for the time period of interest. Thereafter, the viewer preference evaluation 
process 400 obtains at least two sub-sets, VHi and VEfc, from the viewing history 200 during 

25 step 420 and generates a viewer profile, Pi and Pk, corresponding to each sub-set, VHi and 
VH K during step 430. 

The viewer profiles, Pi and Pk, are utilized during step 440 to generate a 
corresponding set of program recommendation scores, Si and Sk, for the programs identified 
in the EPG 1 1 0 for a given time interval. A test is performed during step 450 to determine if 

30 the top-N shows from S i and Sk are the same. If it is determined during step 450 that the top- 
N shows from Si and Sk are the same, then the viewing preferences have not changed 
significantly over time, and a portion of the viewing history 200 can be deleted during step 
460 without loss of information. 
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If, however, it is determined during step 450 that the top-N shows from Si and 
Sk are not the same, then the viewing preferences have changed significantly over time, and 
the recommendations should be presented to user during step 470 based, for example, on 
used-defined preferences. For example, the user can specify that detected changes in viewing 
5 preferences are likely permanent and that the most recent sub-set, VHk, of the viewing 

history 200 should always be used to generate recommendations. Alternatively, the user can 
specify that detected changes in viewing preferences are likely temporary and that some 
combination of the two sub-sets, VHi and VHk, of the viewing history 200, such as a union 
or intersection of the two sub-sets, should be used to generate recommendations. In addition, 
10 the user can specify that detected changes in viewing preferences are likely cyclical in nature 

and that a sub-set, VHk, from a corresponding (similar) earlier time period should be used to 

t 

generate recommendations. f 

5r 

It is to be understood that the embodiments and variations shown and -j 
described herein are merely illustrative of the principles of this invention and that various I 
1 5 modifications may be implemented by those skilled in the art without departing from the 

scope and spirit of the invention. ) 
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CLAIMS: 



1 . A method for identifying changes in television viewing preferences of an 
individual, comprising the steps of: 

obtaining a viewing history (200) indicating a set of programs that have been watched 
by a user; 

establishing at least two portions, VHi and VHk, from said viewing history (200); 
generating a corresponding set of program recommendation scores, Si and Sk, for a 
set of programs in a given time interval based on said at least two viewing history 
(200) portions, VHi and VH K ; and 

comparing said sets of program recommendation scores, Si and Sk, to identify a 
change in said viewer preferences. 

2. The method of claim 1 , wherein said comparing step further comprises the 
step of comparing the top-N (where N is a positive integer) recommended television 
programs in each set, Si and Sr. 

15 

3 . The method of claim 1 , further comprising the step of generating viewer 
profiles, Pi and Pk, corresponding to said at least two portions, VHi and VHk. 

4. The method of claim 1 , further comprising the step of presenting a user with a 
20 set of recommended programs based on one or both of said sets of programs, Si and Sk- 

5. The method of claim 1 , further comprising the step of presenting a user with a 
union set of recommended programs based on said sets of programs, Si and Sk* 

25 6. The method of claim 1 , further comprising the step of presenting a user with 

an intersection set of recommended programs based on said sets of programs, Si and Sr. 
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7. The method of claim 1 , further comprising the step of presenting a user with a 

set of recommended programs, Sk, based on a more recent sub-set of said viewing history 
(200). 

5 g. The method of claim 1, wherein said at least two portions, VHi and VHk, from 

said viewing history (200) are obtained by uniformly randomly sampling sub-sets of 
television programs from said viewing history (200). 

9. The method of claim 1, wherein said at least two portions, VHi and VHk, from 
1 0 said viewing history (200) are obtained by selecting a time span that is less than the entire 

time period covered by the viewing history (200). 

10. The method of claim 9, wherein said selected time span is an earlier similar 
time period to a given time interval. 

15 

11. A method for managing the storage of a viewer history (200) in a television 
program recommender (1 00), comprising the steps of: 

obtaining a viewing history (200) indicating a set of programs that have been watched 
by a user; 

20 - establishing at least two portions, VHi and VHk, from said viewing history (200); 

generating viewer profiles, Pi and Pit, corresponding to said at least two portions, 
VHi andVH K ; 

generating a corresponding set of program recommendation scores, Si and Sk, for a 
set of programs in a given time interval based on said viewer profiles, Pi and Pk; 
25 - comparing said sets of program recommendation scores, Si and Sx/to identify a 
change in said viewer preferences; and 

deleting a portion of said viewing history (200) if said sets of program 
recommendation scores, Si and Sitare substantially similar. 

30 12. The method of claim 1 1 , wherein said comparing step further comprises the 

step of comparing the top-N (where N is a positive integer) recommended television 
programs in each set, Si and Sk- 
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13 . The method of claim 1 1 , wherein said at least two portions, VHi and VHk, 

from said viewing history (200) are obtained by uniformly randomly sampling sub-sets of 
television programs from said viewing history (200). 

5 14. The method of claim 1 1, wherein said at least two portions, VHi and VHk, 

from said viewing history (200) are obtained by selecting a time span that is less than the 
entire time period covered by the viewing history (200). 

15. Hie method of claim 14, wherein said selected time span is an earlier similar 
1 0 time period to a given time interval. 

16. A system (100) for identifying changes in television viewing preferences of an 
individual, comprising: 

a memory for storing computer readable code; and 
1 5 a processor operati vely coupled to said memory, said processor configured to : 

obtain a viewing history (200) indicating a set of programs that have been watched by 
a user; 

establish at least two portions, VHi and VHk, from said viewing history (200); 
generate a corresponding set of program recommendation scores, Si and Sk, for a set 
20 of programs in a given time interval based on said at least two viewing history (200) 

portions, VHj and VHk; and 

compare said sets of program recommendation scores, Si and Sk, to identify a change 
in said viewer preferences. 

25 17. The system (100) of claim 16, wherein said processor compares the top-N 

(where N is a positive integer) recommended television programs in each set, Sj and Sk- 

18. The system ( 1 00) of claim 1 6, wherein said processor is further configured to 
generate viewer profiles, Pi and Pk, corresponding to said at least two portions, VHi and 

30 VH K . 

19. The system (1 00) of claim 16, wherein said processor is further configured to 
present a user with a set of recommended programs based on one or both of said sets of 
programs, Si and Sr. 
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20. The system (100) of claim 1 6, wherein said processor is further configured to J 
present a user with a union set of recommended programs based on said sets of programs, Si 

andSic- I 

5 

21. The system (1 00) of claim 1 6, wherein said processor is further configured to [. 

' i 

present a user with an intersection set of recommended programs based on said sets of - 

■ * I 

programs, Si and S K . ! 

is 

10 22. The system ( 1 00) of claim 1 6, wherein said processor is further configured to | 

present a user with a set of recommended programs, Sk, based on a more recent sub-set of f 

% 

said viewing history (200). | 

23. The system (1 00) of claim 1 6, wherein said at least two portions, VHj and f 
1 5 VHk, from said viewing history (200) are obtained by uniformly randomly sampling sub-sets 

of television programs from said viewing history (200). 

24. The system (1 00) of claim 1 6, wherein said at least two portions, VHi and 

VHk, from said viewing history (200) are obtained by selecting a time span that is less than \ 
20 the entire time period covered by the viewing history (200). 

f 

J" 

25. The system (1 00) of claim 24, wherein said selected time span is an earlier f 
similar time period to a given time interval. |: 

25 26. A system (1 00) for managing the storage of a viewer history in a television ! 

program recommender (100), comprising: \ 

a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said processor configured to: I 

obtain a viewing history (200) indicating a set of programs that have been watched by 
30 a user; 

establish at least two portions, VHi and VHk, from said viewing history (200); 

generate viewer profiles, Pi and Pk, corresponding to said at least two portions, VHi 

and VH K ; 
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generate a corresponding set of program recommendation scores, Si and Syl> for a set * 

i 

of programs in a given time interval based on said viewer profiles, Pi and Pk; 
compare said sets of program recommendation scores, Si and Sk, to identify a change 
in said viewer preferences; and ; 
delete a portion of said viewing history (200) if said sets of program recommendation 

scores, Si and Sicare substantially similar. .r 

< 

27. The system (100) of claim 26, wherein said processor compares the top-N 
(where N is a positive integer) recommended television programs in each set, Si and Sk. 

28. The system (1 00) of claim 26, wherein said at least two portions, VHj and 

VHig from said viewing history (200) are obtained by uniformly randomly sampling sub-sets f 
of television programs from said viewing history (200). 

1 5 29. The system (1 00) of claim 26, wherein said at least two portions, VHi and 

VHk, from said viewing history (200) are obtained by selecting a time span that is less than 
the entire time period covered by the viewing history (200). 

3 0. The system (1 00) of claim 29, wherein said selected time span is an earlier 

20 similar time period to a given time interval. 

r 

31. An article of manufacture for identifying changes in television viewing | 

preferences of an individual, comprising: fe 

a computer readable medium having computer readable code means embodied 
25 thereon, said computer readable program code means comprising: 

a step to obtain a viewing history (200) indicating a set of programs that have been 

watched by a user; 

i. 

a step to establish at least two portions, VHi and VHk, from said viewing history 
(200); 

30 - a step to generate a corresponding set of program recommendation scores, Si and Sk, 
for a set of programs in a given time interval based on said at least two viewing 
history (200) portions, VHi and VH K ; and 

a step to compare said sets of program recommendation scores, Si and Sr, to identify 
a change in said viewer preferences. 
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32. An article of manufacture for managing the storage of a viewer history in a 

television program recommender, comprising: 

a computer readable medium having computer readable code means embodied 
5 thereon, said computer readable program code means comprising: 

a step to obtain a viewing history indicating a set of programs that have been watched 

by a user; 

a step to establish at least two portions, VHi and VHk, from said viewing history; 
a step to generate viewer profiles, Pi and Pk, corresponding to said at least two 

10 portions, VHi and VH K ; 

a step to generate a corresponding set of program recommendation scores, Si and Sk> 

for a set of programs in a given time interval based on said viewer profiles, Pi and Pk; 

a step to compare said sets of program recommendation scores, Si and Sk, to identify 

a change in said viewer preferences; and 
1 5 a step to delete a portion of said viewing history if said sets of program 

recommendation scores, Si and Sjcare substantially similar. 
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